Mutual Information, Fisher Information, and Population Coding
نویسندگان
چکیده
منابع مشابه
Mutual Information, Fisher Information and Population Coding
In the context of parameter estimation and model selection, it is only quite recently that a direct link between the Fisher information and information-theoretic quantities has been exhibited. We give an interpretation of this link within the standard framework of information theory. We show that in the context of population coding, the mutual information between the activity of a large array o...
متن کاملMutual Information, Fisher Information and Population Coding Submitted to Neural Computation
In the context of parameter estimation and model selection, it is only quite recently that a direct link between the Fisher information and information theoretic quantities has been exhibited. We give an interpretation of this link within the standard framework of information theory. We show that in the context of population coding, the mutual information between the activity of a large array o...
متن کاملRelations between Renyi Distance and Fisher Information
In this paper, we first show that Renyi distance between any member of a parametric family and its perturbations, is proportional to its Fisher information. We, then, prove some relations between the Renyi distance of two distributions and the Fisher information of their exponentially twisted family of densities. Finally, we show that the partial ordering of families induced by Renyi dis...
متن کاملOptimal Short-Term Population Coding: When Fisher Information Fails
Efficient coding has been proposed as a first principle explaining neuronal response properties in the central nervous system. The shape of optimal codes, however, strongly depends on the natural limitations of the particular physical system. Here we investigate how optimal neuronal encoding strategies are influenced by the finite number of neurons N (place constraint), the limited decoding tim...
متن کاملInformation Theory: Data Compression, Channel Coding, Entropy, and Mutual Information
This report gives an insight about two major aspects of information theory, including data compression and channel coding. It discusses the simulations results obtained using MATLAB from the information theory view point. It also defines these aspects by using the definitions of entropy and mutual information which reflects the optimum data compression could be obtained and the ultimate transmi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Computation
سال: 1998
ISSN: 0899-7667,1530-888X
DOI: 10.1162/089976698300017115